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SUMMARY 


When  using  radar  to  transit  a  dark  rugged  area,  the  pilot  needs  to  recognize  dangerous 
obstacles  ahead  from  radar  images.  Since  the  radar  image  is  displayed  as  range  versus 
azimuth,  the  obstacles  cannot  be  easily  seen,  and  the  heights  of  obstacles  are  especially 
difficult  to  determine.  It  is  important  to  detect  potential  obstacles  such  as  tall  buildings  so 
that  the  aircraft  can  avoid  collision.  Therefore,  we  investigated  height  reconstruction 
methods  (including  multi-scale  wavelet  and  histogram  analysis)  on  the  extracted  radar 
shadows  formed  by  obstacles.  Preliminary  results  indicated  that  height  construction  was 
successful  even  with  long  thin  shadows  embedded  in  a  noisy  radar  image. 
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1.0  INTRODUCTION 


When  using  radar  to  transit  a  dark  rugged  area,  the  pilot  needs  to  recognize  dangerous 
obstacles  ahead  from  radar  images  [1,  2,  3,  4,  5].  Since  the  radar  image  is  displayed  as 
range  versus  azimuth,  the  obstacles  cannot  be  easily  seen,  nor  can  their  heights  be  easily 
determined.  It  is  important  to  detect  potential  obstacles  such  as  tall  buildings  so  that  the 
aircraft  can  avoid  collision.  For  example,  in  the  picture  on  the  left  of  Figure  1,  the  pilot 
needs  to  fly  over  or  around  the  towering  smokestack  in  the  foreground.  Its  corresponding 
radar  image,  on  the  right  of  Figure  1  -  in  B-scope,  does  not  clearly  show  the  smokestack 
or  even  approximate  its  height. 


Figure  1:  Left:  Tall  buildings,  natural  objects,  and  long-thin  smokestack;  Right:  Radar  image 


The  radar  returns  can  be  displayed  as  the  range  to  targets  on  an  oscilloscope  -  a  display 
often  referred  to  as  the  range  scope  or  A-scope.  In  order  to  provide  an  improved  spatial 
sense  of  the  scene,  a  B-scope  displays  the  range  along  the  vertical  axis  and  its 
corresponding  radar  azimuth  (angle)  on  the  horizontal  axis  in  a  2-D  display.  It  is  a  range 
vs.  angle  display  of  the  scene.  However,  as  the  above  example  shows,  it  does  not  convey 
an  object’s  height.  An  alternative  -  the  C-scope  -displays  elevation  (angle)  information 
on  the  vertical  axis.  This  angle  vs.  angle  display  presents  a  perspective  view  of  the  scene 
as  in  ordinary  optical  imagery,  e.g.,  a  human  eye,  camera,  etc.  Since  all  objects  need  to 
be  perspectively  projected  in  C-scope,  the  object  height  information  need  to  be  first 
determined  from  the  radar  returns.  Tall  objects  can  reflect  the  radiating  energy  back  and 
cause  a  black  shadow  (receiving  no  illumination)  behind  its  structure.  The  length  of  the 
shadow  represents  the  object’s  height  above  the  flat  terrain.  Such  information  has  in  the 
past  been  used  to  infer  the  object  heights  [6,  7,  8].  Thus,  the  overall  objective  of  this 
project  is  to 

1)  Convert  a  B-scope  image  to  a  C-scope  image  so  that  human  operators  can  easily 
understand  the  image  content. 
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2)  Extract  the  shadow  formed  by  obstacles  on  a  B-scope  image. 

3)  Reconstruct  the  height  from  the  recognized  shadow  onto  the  C-scope  image  [9, 

10]. 

This  project  mainly  focuses  on  the  last  two  issues. 

2.0  METHODS 

As  shown  in  Figure  2,  using  the  input  from  a  B-scope  image,  the  following  steps  are 
performed: 

1)  multi-scale  and  histogram  analysis  - 

(a)  de-noise  the  B-scope  image, 

(b)  recognize  the  weak  shadow  signal,  e.g.,  the  smokestack  attached  to  the  tower 
in  B-scope,  along  the  azimuth  direction,  and 

(c)  extract  edges  from  the  de-noised  B-scope  image. 

2)  noise-based  shadow  extraction  -  extract  shadow  intervals  because  there  is  no 
signal  return  except  noise  in  the  shadow  area. 

3)  height  reconstruction  from  shadow  -  extract  height  information  based  on 
geometric  principles  in  shadow  projection. 

4)  height  conversion  from  B-scope  to  C-scope  -  convert  and  display  the  height  in 
the  C-scope. 


Figure  2:  Flowchart  of  shadow  extraction  and  height  reconstruction 


The  output  is  the  reconstructed  height  on  the  converted  C-scope  image.  The  detailed 
techniques  are  given  in  the  following  sections. 
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2.1  Multi-scale  and  Histogram  Analysis 


In  Figure  3,  the  big  building  such  as  a  tower  has  a  clear  and  wide  shadow,  which  can  be 
easily  recognized  and  extracted.  However,  it  is  not  so  easy  to  isolate  the  thin  and  noisy 
shadow  of  the  smokestack,  which  is  especially  important  for  flight  safety.  We  apply 
multi-scale  wavelet  and  histogram  analysis  on  the  B-scope  image  to  filter  noise  and 
isolate  the  weak  signal,  i.e.,  the  thin  and  noisy  shadow. 


Clear  and  wide 


Thin  and  noisy 


Figure  3:  Different  shadows  on  the  tower  B-scope  image 

Figure  4  gives  the  flowchart  of  such  multi-scale  and  histogram  analysis.  For  a  given  B- 
scope  image,  we  first  apply  multi-scale  analysis  to  filter  the  noisy  image  through  a 
wavelet  de -noise  tool  and  obtain  a  de -noised  B-scope  image.  With  the  de-noised  image, 
we  detect  the  edge  features  and  histogram  the  edge  features  along  the  azimuth  direction. 
As  the  result,  we  obtain  an  edge-information-based  image,  in  which  it  is  easy  to  detect 
the  smokestack.  The  synthetic  example  below  illustrates  how  this  multi-scale  wavelet  and 
histogram  analysis  can  achieve  better  results  with  a  weak  or  noisy  signal. 


Figure  4:  Flowchart  of  multi-scale  and  histogram  analysis  on  a  B-scope  image 
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In 


Figure  5,  the  shadow  in  the  image  can  be  easily  detected  via  the  edge  histogram  when  the 
noise  scale  is  lower  than  0.5.  Noisy  image  is  first  computed  by  subtracting  the  original  B- 
scope  from  its  de-noised  image.  The  noise  scale  is  the  RMS  value  of  the  noisy  image. 
However,  when  the  noise  scale  equals  0.9,  the  shadow  from  the  image  could  not  be 
reliably  extracted  and  the  edges  histogram  analysis  is  not  helpful.  In  such  a  case,  we  then 
conduct  multi-scale  wavelet  analysis  to  extract  the  shadow  information.  The  approach  is 
demonstrated  next. 


Figure  5:  Signal  recognition  through  edge  histogram  analysis 
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As  can  be  seen  in  Figure  6,  the  shadow  on  the  image  can  be  detected  from  the  edge 
histogram  of  the  image  after  five  levels  of  multi-scale  wavelet  analysis.  Therefore,  we 
demonstrated 

1)  multi-scale  wavelet  analysis  can  be  used  to  remove  the  noise  from  the  original  noisy 
image  and  enhance  the  signal,  and 

2)  multi-scale  and  edge  histogram  analysis  can  effectively  detect  the  thin  and  long  weak 
signal  on  a  noisy  image. 


Figure  6:  Multi-scale  and  histogram  analysis  on  the  image  with  noise  scale  0.9 


Therefore,  we  select  the  multi-scale  wavelet  and  histogram  analysis  to  extract  the  weak 
shadow  signal  in  the  B-scope  image.  The  example  below  depicts  the  steps  of  the  multi¬ 
scale  wavelet  and  histogram  analysis  performed  on  our  B-scope  image. 
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In  Figure  7,  the  large  size  B-scope  image  (600x16384)  is  decomposed  into  four  smaller 
size  B-scope  images  (600x4096),  and  multi-scale  wavelet  analysis  (3  levels)  is  performed 
for  each  sub-image;  these  sub-images  are  then  recombined.  Finally,  the  edge  information 
is  extracted  using  the  Canny  edge  detection  tool.  From  the  edge  histogram,  the  weak 
signal  of  the  long  thin  smokestack  can  now  be  easily  recognized. 


Decomposition  Mul''^™^sis  Composition  Ed9e  Edge  Histogram  along 

thru  wavelet  extraction  ranqe  direction 


Figure  7:  Multi-scale  and  histogram  analysis  on  a  B-scope  image 

2.2  Noise-based  Shadow  Extraction 

Figure  8  describes  the  geometric  projection  principle  of  the  overlay  and  shadow  in  a  B- 
scope  image,  which  also  leads  to  three  sharp  changes  of  the  image  intensity:  from 
background  to  overlay,  from  overlay  to  shadow,  and  from  shadow  to  background.  The 
sharp  changes  of  intensity  imply  that  there  are  edge  features  present,  and  the  shadow 
intervals  along  the  elevation  direction  are  between  those  edge  features.  In  addition,  the 
shadow  is  the  noisy  interval  that  has  no  returned  signal.  Such  characteristics  form  the 
noise-based  shadow  extraction  approach.  The  following  flowchart  in  the  next  figure 
shows  the  noise  based  shadow  extraction  approach. 


3AR 


y 


Background  Overlay  Shadow  Background 


Intensity 


Intensity  sharp 
change 

Edge  features 


Intensity  sharp 
change 


Edge  features 


Figure  8:  Edge  features  extraction  from  the  intensity  change  on  the  B-scope 
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As  shown  in  Figure  9,  three  steps  are  included  to  extract  shadow  intervals: 


1)  noise  computation  by  subtracting  the  de-noised  B-scope  from  the  original  B-scope 
image  (Figure  10), 

2)  extract  the  possible  shadow  intervals  between  two  edges  on  the  edge  image,  and 

3)  validate  the  shadow  interval  with  noise  thresholds  0  and  0 . 


Figure  9:  Flowchart  of  noise-based  shadow  extraction  approach 


Raw  Bscope  De-rioised  Bscope  noise 


Figure  10:  Noise  computation  by  subtracting  de-noised  B-scope  from  raw  B-scope 

Based  on  the  computed  noise  and  possible  shadow  interval,  we  can  extract  the  true 
shadow  intervals  with  noise  thresholds  0  and  0 . 

The  noise  thresholds  0  and  0  can  be  selected  in  the  following  way: 

1)  compute  the  mean  value  of  noise, 

2)  6  start  from  zero  and  increase  until  the  reconstructed  height  looks  more  realistic, 
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3)  O'  then  starts  from  6  and  increases  until  the  reconstructed  height  of  smokestack  looks 
more  realistic. 

During  the  noise  thresholds  0  and  O'  selection  process,  the  height  needs  to  be 
reconstructed,  as  detailed  in  the  next  section. 


2.3  Height  Reconstruction  from  Extracted  Shadow 


From  the  geometric  relationship  between  the  height  H ,  slant  length  L ,  Lx,  the  Altitude 
between  radar  and  ground,  and  angle  <p  in  Figure  1 1,  we  have 


cp  =  arcsin 


Altitude 


,  and  H  =  {L-Lx  )sin(<^) . 


(1) 


Figure  11:  Geometric  relationship  between  the  height  and  shadow 

Based  on  slant  length,  we  use  Eq.  1  to  reconstruct  height  for  each  shadow  interval. 
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2.4  Conversion  from  B-scope  to  C-scope 


This  section  describes  the  procedure  used  to  convert  the  height  from  the  B-scope  to  the 
C-scope. 

As  shown  in  Figure  12a,  there  is  a  mapping  interval  in  B-scope  to  C-scope  conversion, 
the  intensity  of  one  pixel  in  the  C-scope  is  mapped  to  the  mean  value  of  a  mapping 
interval  on  the  B-scope.  When  the  pixel  marking  the  base  of  the  obstacle  is  mapped  to 
the  correct  pixel  in  the  corresponding  C-scope  display,  the  height  will  be  accurately 
reconstructed  as  shown  in  Figure  12b.  However,  if  it  is  not  correctly  mapped  as  in  Figure 
12c,  the  obstacle  height  will  not  be  accurately  portrayed  (the  height  should  be  H\  not 
H ).  The  following  approach  (shown  in  Figure  13)  is  therefore  used  to  convert  the  height 
in  the  B-scope  to  C-scope. 


*  I  »  i  *  * 

r  *1  Bscope 

(a)  Principle  of  Bscope  to  Cscope 


i-J - 4 - - 1 - % - - 

p - H  Bscope 

(b)  Accurate  height  reconstruction  at 
the  mapping  pixel 


Bscope 


(c)  Inaccurate  height  reconstruction  for  the 


Figure  12  :  Height  conversion  from  B-scope  to  C-scope 
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As  shown  in  Figure  13,  H  is  the  actual  height  of  the  building,  H'  is  the  height  of  the 
obstacle  that  should  be  mapped  to  the  C-scope.  In  the  triangle  T  shown  in  Figure  13,  we 
have 


A 

sin(90°  -  (px ) 


sin  (q\-<p)' 


(2) 


Figure  13:  “Far  height”  reconstruction  after  the  mapping  interval  expanding 


Thus,  from  Eq.  2,  the  height  H'  can  be  calculated  from 

H,_  Asinfa-p) 

cos(^) 


(3) 
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3.0  RESULTS  AND  DISCUSSION 


Figure  14  shows  the  converted  height  as  displayed  in  the  C-scope  (with  noise  thresholds 
#'  =  9.6xl06  and  #  =  2.8xl06).  Comparing  to  the  visual  scene  in  Figure  14a,  it  is  clear 
that,  while  the  B-scope  (Figure  14b)  display  misrepresents  the  smokestack  height  and  its 
location,  the  tall  buildings,  trees  in  the  foreground,  and  the  thin  weakly  imaged 
smokestack  in  the  converted  C-scope  (Figure  14c)  have  all  been  successfully 
reconstructed. 


(a)  Picture 


(b)  Bscope 


(c)  Converted  Cscope  and 
reconstructed  height 


Figure  14:  Reconstructed  heights  from  extracted  shadows 


4.0  CONCLUSIONS 

In  this  report,  we  documented  the  following  analysis: 

■  Edge  features  can  be  used  to  extract  possible  shadow  intervals,  which  are  then 
used  to  reconstruct  the  height  in  C-scope. 

■  Multi-scale  wavelet  analysis  can  be  used  to  (a)  filter  noise  and  (b)  enhance  the 
weak  features  (e.g.,  smoke  stack  detection)  along  the  azimuth  direction. 

■  Edge  histograming  can  be  applied  to  different  scales  of  the  image  to  extract  the 
smoke  stack. 

■  Noise  is  computed  by  subtracting  B-scope  from  its  de-noised  image  and  this 
estimated  noise  is  then  employed  to  eliminate  the  non-shadow  interval. 

■  Accurate  height  reconstruction  can  be  performed  during  B-scope  to  C-scope 
conversion. 

The  combination  of  multi-scale  wavelet  and  edge  histogram  analysis  is  successful  in 
identifying  the  features  even  when  they  are  long,  thin  and  corrupted  by  noise. 
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6.0  GLOSSARY  OF  TERMINOLOGY 


A-scope:  radar  display  of  the  range  to  targets  along  a  scale. 

B-scope:  a  2-D  "top  down"  representation  of  space,  with  the  vertical  axis  typically 
representing  range  and  the  horizontal  axis  azimuth  (angle). 

C-scope:  a  "bull’s  eye"  view  of  azimuth  vs.  elevation. 
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